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Abstract 

The Gauss- Jordan elimination algorithm is extended to reduce a row- 
finite oj x uj matrix to lower row-reduced form, founded on a strategy of 
rightmost pivot elements. Such reduced matrix form preserves row equiv- 
alence, unlike the dominant (upper) row-reduced form. This algorithm 
provides a constructive alternative to an earlier existence and uniqueness 
result for Quasi-Hermite forms based on the axiom of countable choice. 
As a consequence, the general solution of an infinite system of linear 
equations with a row-finite coefficient ui x ui matrix is fully constructible. 
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1 Introduction 

The Gaussian elimination, the fundamental tool in reducing matrix problems 
to simpler ones, from the ancient times (see [T]) up to the modern age (see 0) 
is dominated by strategies founded on leftmost pivot elements. When it is sup- 
plemented with Jordan elimination, it generates the upper row-reduced echelon 
form (URREF) of a matrix. This is the most widespread row canonical form 
of finite matrices, within the meaning that every finite matrix is reducible to 
a unique URREF, no matter what method is used. Even though the lower 
row-reduced echelon form (LRREF) is also row canonical, the URREF has ap- 
propriated the entire use of the term "row-reduced echelon form" . As it turns 
out, however, leftmost pivot strategies (LPS) along with matrices in URREF 



1 



are serious obstacles in extending the Gauss- Jordan elimination to cover the 
algebra RFM W (J 7 ) of row- finite oj x oj matrices over a field T . 

In all that follows, the shorthand notation LRRF (resp. URRF) stands for a 
lower (resp. upper) row-reduced form, without requiring the echelon conditions. 
Following earlier work of Toeplitz [3] , Fulkerson introduced in [4 J]] the notion 
"Quasi-Hermite form" (QHF) of a row-finite wxw matrix, establishing there 
existence and "almost" uniqueness results largely ignored for a long period. 
These results, briefly presented in Section [3J are one of the main sources of 
motivation of this study. As shown in Section 01 a QHF is a row-finite u> x u> 
matrix in LRRF, the nonzero rows of which are of strictly increasing row-length. 
Let C £ RFM^J"). By the "existence of a QHF of C" it is meant that there 
is a QHF, say H £ KFM w (J r ), such that C and H are left associates (or row 
equivalent). Fulkerson's proof on the existence of a QHF of C, as implicitly 
stated in [U Theorem 3.1], necessarily involves the axiom of countable choice 
(see Section [2]). It enabled him to overcome the lack of a certain rule for 
choosing a complete basis of row-length, say A = (Ak)k, from the length- 
equivalence classes of the row space of C. The nonzero rows of H are connected 
by a recurrence relation with the mediation of elements of A. Because of the 
non-constructive nature of the axiom of countable choice, the presence of this 
axiom prior to the recurrence, reduces the constructibility of this recurrence 
to cases in which a complete basis of row-length is given in advance by C (see 
Examples 033 HU) . By way of contrast, the algorithm proposed here provides a 
certain rule for choosing a complete basis of row-length (see Propositions [36l 
[38]) . establishing the constructiveness of QHF of C. 

The implementation of the Gauss- Jordan elimination with rightmost pivots 
is referred to as rightmost pivot strategy (RPS). The infinite Gauss- Jordan 
algorithm (see Section [SJ consists of an effective routine implemented with 
RPS generating a chain of matrices with finite number of rows in LRRF. It 
starts with the reduction of the top submatrix of an arbitrary C G RFM W (J 7 ) 
extended up to and including the second nonzero row of C, and then repeatedly 
apply to reduce matrices comprising the previously reduced matrix augmented 
by successive rows of C one at a time and ad infinitum. This avoids the 
apparent difficulty due to the direct application of the Gauss Jordan algorithm 
to the entire C, which generally requires an infinite number of row operations 
to eliminate the nonzero entries of a pivot column. The question now turns 
to whether the above-mentioned infinite chain of row-reduced matrices, upon 
algorithm completion, ends up as a matrix in LRRF row equivalent to C . 

The infinite Gauss- Jordan algorithm implemented with LPS has conse- 
quences in the row reduction of uj x lj integer valued row-finite matrices modulo 
a prime power (see [5]). As a general strategy, however (see Example [55]) , LPS 
forces us to choose from two undesirable alternatives: Either that the infinite 

1 I thank Travis D. Warwick, Librarian of the Stephen Cole Kleene Mathematics Library 
at University of Wisconsin - Madison, for making Fulkerson's Thesis available to me. 
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elimination leads to an undecidable problem or that it ends up as a matrix in 
URRF, but not preserving row equivalence. Apart from the case of invertible 
row-finite matrices (see the reference previously cited), it is shown here that 
there is no row equivalent URRF for an extensive class of row-finite matrices. 
However, the implementation of the infinite Gauss- Jordan algorithm with pri- 
ority to RPS makes it possible to overcome the impasse regarding LPS. It is 
proved in Theorem [32] that as the process proceeds, after a sufficiently large 
but finite number of algorithmic steps, every row remains invariant. As a 
consequence, upon algorithm completion, a row equivalent matrix in LRRF is 
accomplished (see Section[7]). It is further shown the existence of QHF, without 
invoking the countable axiom of choice. 

Matrices in LRREF require that all zero rows are grouped on the top (resp. 
bottom) of the matrix. Thus, the LRREF of C € RFML(J"), having infinite 
nullity (resp. rank) and nonzero rank (resp. nullity), must have at least the 
ordinal uj + 1 as row indexing set (see Example I4T)]) , thus not belonging to the 
algebra RFM w (J r ). Within this algebra, however, an almost uniqueness result 
is feasible, as established in [3] for QHFs. If the nullity of C is finite a complete 
uniqueness result for the LRREF of C follows directly (see Example [44)) . 

The full replacement of the axiom of countable choice by the infinite Gauss- 
Jordan algorithm implemented with RPS enables us to infer the existence of 
a LRRF and a QHF from the constructiveness of these forms, just as in the 
finite dimensional case. In Section [5] the infinite Gauss- Jordan algorithm is 
supplemented with a reordering routine for constructing a chain of submatrices 
of a QHF of the original matrix. Moreover, an alternative algorithmic scheme 
is proposed, which establishes links with the currently developed software. 

A remarkable application of the algorithmic process, proposed in this paper, 
concerns the construction of the general solution for infinite systems of linear 
equations associated with an arbitrary row-finite coefficient uj x uj matrix, which 
is discussed in the last Section of this paper. 

2 Preliminary Notation and Results 

Throughout this paper, the set of natural numbers N = {0, 1,2, ...} endowed 
with the standard well ordering by magnitude is identified, as usual, with the 
ordinal number u>. Also, T stands for an algebraic field and for the vector 
space of sequences in T of only finitely many nonzero terms. The canonical 
basis of is denoted by E = {ei} ieLU , where = (<%) jeLJ and <5jj is the 
Kronecker delta function. A row-finite ui x u> matrix A is a sequence of vectors 
in J-( u ^ indexed by uj and denoted by A = (A^k^u = (^fti)(fc,i)Gwxw 

Also, 

I = (ei) ieuJ stands for the identity uj x uj matrix. A row A k g of A is 

written as: 

Pk 

Ak = (ofco ? Ofci,...,afc Pfc ,0,0...) = ^a fci e l (1) 

i=0 
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Using set notation, we write A = {(k, A k ) : k £ oj, A k £ J 7 ^} C u> x J 7 ^ by 
means of which repeated rows become distinguishable. The set (J 7 ^)" of row- 
finite lu x u matrices, equipped with the matrix addition and multiplication 
by scalars, turns into a linear space over T. If (J 7 ^)^ is further equipped 
with matrix multiplication, linear and ring structures turn (J 7 ^)" into an 
associative and noncommutative algebra with identity element the matrix I, 
denoted by IRFM^J 7 ). For a general reference on nontrivial definitions and 
results on matrix rings over arbitrary indexing sets, the reader is referred to [5] 
and to the literature cited therein. 

Let A £ RFM w (7 r ) and A k = (a ki ) ieu be a row of A. Following Toeplitz [3], 
in view of (fTJ), the index p k is called length (or rightmost index) of A k and 
alternatively will be denoted by £(A k ). The rightmost nonzero coefficient a kpk 
of A k will be also termed right leading coefficient of A k . Certainly £(ei) = i for 
i £ lj, thus £(eo) = 0. As £(0) does not exist in w, the convention £(0) = —1 
is adopted. Let X C J 7 ^. The set Dt(X) = {£{x) : x £ X} will be called 
set of rightmost index of X. Let F be a sequence of nonzero vectors of J 7 ^ 
indexed by J C uo. Evidently the map of rightmost index of that is p : J t— > 
9\(F) : p(j) = £(Fj), is surjective and defines the sequence of rightmost index 
of F denoted by p — (pj)j^j. If p is injective, then the indexed set notation 
{pj}jej is used along with the standard identification of {pj}jej with 9\(F), 
when the former is treated as the image set of p. By analogy we define the 
leftmost index of A k denoted by £(A k ), k £ J or simply along with the left 
leading coefficient a k ^ k of A k . The convention £(0) = — 1 is also adopted. The 
sequence and the set of leftmost index of A are denoted by C = (Cj)jeJ and 
£(A), respectively. From now onwards, the indexing sets of zero and nonzero 
rows of A £ IRFMcj (J 7 ) are denoted by W, J respectively. 

Matrix Representations of Linear Mappings on J 7 ^. In all that follows 
the space of linear mapping s from J 7 ^ to J 7 ^ over J 7 will be denoted by 
Homjr^H). Let / £ Horn^M). The kernel and the range of / will be 
denoted by Ker(/) and Im(/) respectively. By X = {xk}ke^, B = {M lGw , 
we shall refer to Hamel bases (or bases) of the domain and codomain of / 
respectively. The matrix representation of /, relative to (X ', B), is a row-finite 
matrix A = {au){k,i)^uxu witri entries determined by f(xk) = J2i a ki^i and 
we shall referred to it as A = On the other hand, if A € MFM^J 7 ), there 

is a unique linear extension of Xk <-> J2i a ki^i to Homjr(J r ^- ) ), call it /, such 
that A — [f]x. A row A k of A represents the element f(xk), relative to B. 

The matrix multiplication on RFM^ (J 7 ) is defined in complete analogy with 
finite matrices, resulting in a matrix in KFM w (J r ). If £ £ J 7 ^, the mapping 
a : J 7 ^ 3 £ t— >• = £ • A £ J 7 ^ will be called the induced linear mapping 

2 The "length" can also be viewed as the distance of p k from the zero-index, which justifies 
this terminology. However, this quantity is an element of u, thus being itself a finite ordinal. 
This is not to be confused with the "length of a vector" defined as a Euclidean distance. 
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by A. In this setting, A is treated as a right operator and A — [a]j£, since 

Pk 

a(e k ) — e k ■ A = {a kQl a k i, ...,a kpk ,0,0...) = ^a fci ej. 

t=0 

Change of Bases and Left Association. If a left and a right inverse of 
A G RFM^J 7 ) exist in KFM w (J r ), then they necessarily coincide defining the 
two-sided inverse of A and A is said to be non-singular or invertible. In this 
setting, the existence of a left (resp. right) inverse entails that the induced linear 
mapping is surjective (resp. injective), whence the following Proposition: 

Proposition 1. Let a € Homjr('F^). Then a is an isomorphism if and 
only if A — [a]j| is non-singular. 

If X C J 7 ^ spans a subspace Z of J 7 ^, we shall write span(X) = Z. 
The null space and the row space of A G MFM w (J r ) are defined by NS(A) = 
Ker(a) = {£ G : £ • A = 0} and RS(A) = Im(a) = span^)^. The 

Hamel dimensions of these spaces are called nullity and ranfc of A, respectively, 
writing mil(A) = dim(NS(A)), rank(A) = dim(RS(A)). Let / G Honi^J"^)) 
and A = B = [/]§,, where = {x£} fc6u is another basis of J 7 ^. 

Let also (f> : X ^ X* be defined by x* k = <l>(Xk) and 4>{\k) = YlilkiXi- A s 
the unique linear extension of the bijection <ft, say ip : J 7 ^ H> is an 

isomorphism, the matrix Q = (qki)(k,i)euixuj = [<p\x is non-singular, called the 
matrix of passage from the basis X to the basis X*. This passage of bases 
causes a change of the matrix representation of / from A to B, for a fixed basis 
B of the codomain space, described by 

QA = B. (2) 

Let Q G RFM^J 7 ) be non-singular such that © holds. Then A, B is said to be 
left associates or row-equivalent and we shall write A ~ £?. Formally "~" is an 
equivalence relation on RFML^J 7 ), which generalizes the prevailing notion of 
"row-equivalence" for finite matrices. A change of the domain basis gives rise 
to row equivalent matrix representations of a linear mapping and visa versa. 

Permutation Matrices and a Rearrangement Theorem. Given a bi- 
jection o~ : u) i — ^ cj, the permutation matrix P = {jpij)uj)^ u xu m RFIMLj(.F) is 
defined by: pij = 0, if j ^ Oi, or p ilJi — 1. Pre-multiplying A G RFM iJ (J r ) 
by P a permutation of the rows of A occurs. Let a, /i be bijections on co and 
Pot Py, be the corresponding permutation matrices. Then P a ■ P p = P poa and 
P a -i = P„. Thus, a permutation matrix is non-singular, and its inverse is a 
permutation matrix too. 

Let J = {jO)Ji) •■•} be an infinite subset of uj such that jo < ji < .... Let 
also <p '■ J l— * w be injective and i£ = {'Pj ,^Pj 1 , ■ •■} (the set of images of ip). 
The mapping cr is defined by the following inductive process: 
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i) The first element, jo, of J is mapped to ko £ J (fco = cr (jo)) if and 
only if ifk is the first element of K. 

ii) The n-th element, j n , of J is mapped to k n £ J (k n — cr(j n )) if and 
only if ip kn is the first element of K \ {(p ko ,cp kl , ...,(p kn _ 1 }. 

Applying elementary arguments involving mathematical induction, we deduce 
that the map J 3 j H> a(j) = <jj £ J is bijective and the sequence (<t>o-i)i£j, 
defined by the mapping <j) o o~(i), i £ J, is strictly increasing. Hence, without 
invoking the countable axiom of choice, the following Theorem holds: 

Theorem 2. Let J ^ and JCw. If <f> : J h-> cj is injective, there exists 
a bijection a : J i— > J such that the sequence ((/v^gj is strictly increasing. 



Hermite Bases and Quasi-Hermite Forms. The existence and unique- 
ness results on QHFs of row-finite lu x u matrices, attributed to Fulkerson [J], 
are based on the notion of Hermite bases of subspaces of 

Definition 3. A family H = (hj)j e j of vectors of J-^\ J C lo, is a 
Hermite basis of a subspace Z of J-^\ if H fulfills the subsequent conditions: 
(i) H spans Z. (ii) The sequence p — (pj)jej of rightmost index of H is strictly 
increasing, (iii) hj Pj = 1 for all j £ J (The rightmost coefficients are ones), 
(iv) If k £ lj and j £ J such that j < k, then hk Pj = (All entries in the same 
column and below a right leading one are zero). 

Let Z be an infinite dimensional subspace of Let also L p be the set 

of vectors in Z of fixed length p £ D\(Z). The infinite family L = {L p } p g<H(2) 
partitions Z into pairwise disjoint sets such that Z = ( L p )U{0}, which 

pem(z) 

thus called set of length- equivalence classes of Z. Following Fulkerson [4], let 
us choose a representative vector A p from each L p , thus forming a sequence 
A = {A p } p6K (2) i n -2- I 11 this respect, one formally asserts the existence of 
an injective choice mapping $:Lh> UL such that $(IL p ) = A p £ L p , that is 
a standard form of the axiom of countable choice. Let 9\{Z) — {po, p±, p2, ■■■} 
with po < pi < p2 < and A Pj . = (a!jo> o^i, aj p , , 0, 0, ...). The sequence 
H = {H Pj }j £w in Z generated recursively by 

a 0po A Po ^ 
a 3Pj(~^~Pi ~ a 3Pj-l^-Pj-l ~ ••• ~ a iPoH po ) 

turns out to be a Hermite basis of Z, thus establishing the existence of this 
type of bases. The uniqueness of H follows directly from Definition [3] In view 
of ©, £(U P] ) = £(A Pj ) = ^ for all j £ u, thus 

91(2:) = gt(A) = JH(H). (4) 
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Relation ([3]) is to be compared with an analogous recurrence established in [6 . 
The latter recurrence generalizes an earlier result devised by Ortiz [7jf| gener- 
ating the so-called canonical polynomials. 

Definition 4. He MFM w (J r ) is said to be in Quasi- Hermite form if the 
set of nonzero rows of H is the Hermite basis of RS(iJ). 

Theorem 5 (Existence- Uniqueness) . Let A E RFM w (J r ). i) There is a 
non-singular matrix Q E RFM^J 7 ) such that Q ■ A is in QHF. ii) H\, H% are 
two QHFs of A if and only if there exists a permutation matrix P E MFM W (T) 
such that Hi = P ■ H 2 . 

The matrix H := Q ■ A resulting from Theorem [5] is said to be QHF of A. 
An equivalent statement to the definition of left association, shown in 0], is 
presented below. 

Proposition 6. Two row-finite matrices in RFM^J 7 ) are left associates 
(or row equivalent) if and only if they have the same row space and nullity. 

Using RS(A) in place of Z, condition (j4]) of recurrence (|3]) takes the form: 

«R(RS(A)) = D\(A). (5) 

3 Complete Bases of Right/Leftmost Index 

A commonly known Hamel basis of J-^ is the set of rows of a lower triangular 
uj x oj matrix with nonzero elements in the diagonal, as indicated below. 

Proposition 7. An indexed set M = {nij}i ew with E defined by 



for Xn and < Q < i, 



fe=C< 

is a Hamel basis of . 



(6) 



By assuming that Xik — for all k such that < k < Q, we can identify Q 
in (|^J) with zero and we shall adopt this convention throughout this paper. In 
this regard, the coefficient matrix (\ik)(k ,i)euxu> m @ is lower triangular with 
nonzero elements in the diagonal. Moreover (Xik)u t k)euxuj indicates the matrix 
of passage from the basis E to the basis M, thus being non-singular. Besides, 
the next statement holds (see Bourbaki [9l Proposition 21 pp. 218]). 

3 Ortiz' recursive formulation of the Lanczos' tau method was the starting landmark for a 
considerable amount of work in the area of polynomial approximations to differential prob- 
lems, centered at Imperial college for more than twenty years. The author of this paper has 
had the fortune to work in this area under the supervision of Prof. Eduardo Ortiz. 
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Proposition 8. Let A G KFM W (J') and {Aj}j eJ be a basis ofBS(A). Let 
also a be the induced linear mapping by A. i) If (zj)j e j is a sequence in 
such that (x(zj) — Lj for all j G J, then (zj)j^j is a basis of a complementary 
space ofNS(A). ii) If W = oj\ J, then card(VF) = nul(A). 

Let a G Homj^'")) and A = {A k ) keu = [a]|. If {A k } keu is a basis 
of J 7 ^, then a(e k ) = A k for all fc G w. Thus Proposition [8] implies that 
Im(a) = J 7 ^' and NS(A) = {0}, whence a is an isomorphism. 

Lemma 9. Let (pi)i£ U be a sequence in to such that i < pi. Let also 

Pi 

n 2 = A ifc e fe , (7) 

k—i 

where Xu ^ 0. The indexed set n = {n.;} iew with n, G J 7 ^ is linearly 
independent. 

Proof. If F is a finite subset of n, there exists some large enough m G to 
such that F C {nj} <i< m . Let M = max(pi) <j<m and U = {ni} <i< m U 
{ei} m +i<i< M - Let also e be the standard embedding of J rM + 1 into J 7 ^ and 
e _1 the isomorphism e _1 : Im(e) i-> J™ +1 , In view of (0, the elements of 
e _1 (U) form an upper triangular finite (M + 1) x (M + 1) matrix with nonzero 
elements in the diagonal, and so the set e~ 1 (U) is a basis of 7 7M+1 . Since 
e -1 (F) C e" 1 (U), e _1 (F) is linearly independent and so is F. As F was 
arbitrary, n is linearly independent. □ 

However, as shown in the next counterexample, n is not in general a basis 
of J 7 ^ , unlike the analogous result for finite matrices and that of Proposition 
[3 Let a = (a.i)i£ U with &i = e, + e;+i for i G u). Proposition [7] implies that 
aU{e } = {e , e +ei, ei+e 2 , ...} is a basis of J 7 '"'. Accordingly e ^ span(a), 
namely span(a) 5 Thus a is not a generating system of J 7 '"'. 

Definition 10. A Hamel basis F of Z, which satisfies *K(F) = 9\(Z) 
(resp. £(F) = £(Z)), will be referred to as a complete basis of rightmost index 
(resp. leftmost index) of Z. If Z is the row space of a matrix, then we shall 
cquivalcntly use the terms "row-length" and "rightmost index" . 

In view of (g]), the bases H and A whose terms are connected by © are 
complete bases of rightmost index. Two useful complete bases of rightmost 
index (resp. leftmost index) of subspaces of J 7 ^ are given in what follows. 

Proposition 11. Let F = (Fj)j e j be a family of nonzero vectors in J 7 ^. 
Let also Z = span(Fj)j e j. i) If the sequence (pj)jeJ of rightmost index of 
F is injective, then F is a complete basis of rightmost index of Z. ii) If the 
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sequence (Cj)jeJ °f leftmost index of F is injective, then F is a complete basis 
of leftmost index of Z. 

Proof, i) Since 91(F) C 91(Z), we are to show that 91(Z) C 91(F). Let i e 
91(Z). By definition there exists some Z S Z such that £(2') = z. As F 
spans Z, we conclude that Z = X 0l Fj 1 + Xj 2 Fj 2 + ... + Xj n Fj n . Since p is 
injective, we may assume that pj t < pj 2 < ... < pj n . Thus i — pj n 6 91(F), as 
required. In showing that F is basis of Z, it remains to show that F is linearly 
independent. Whereas p : J i-> to is injective and 91(Z) = 91(F), it follows that 
p : J h> 91(Z) is bijective. Accordingly, the terms of F can be relabeled by 
setting F' p . = Fj for all j 6 J. Since {F^. } je j and {F-} ie ^(.z) coincide as sets, 
the terms oi X = {F-}j SK (2) U {ei} iew \ K (2) satisfy ([6]). Proposition [7] implies 
that X is a basis of J 7 '"''. Since F = {F^} ie9l ( Z ) C A" the assertion follows, 
ii) By substituting £ for p and using the above arguments, we conclude that 
£(Z) = £(F). Whereas ( : J (->• £(F) is bijective, we define F£. = Fj for j e J 
and F = {F' c .} jeJ = {F^} me£(F) . The set {F^} me£(F) U {e m } mew \ £(F) is 
linearly independent, as satisfying ([?])■ and so is its subset F, as required. □ 

Corollary 12. Let A g RFM w (J r ). Let aiso the sequence of rightmost 
index (resp. leftmost index) of the nonzero rows, say (Aj)j^j, of A be injec- 
tive. Then: i) The indexed set (Aj)j e j is a complete basis of rightmost (resp. 
leftmost index) of RS(A). ii) card(VK) = nul(A) (W = w \ J). 

Proof. Proposition[TT] applied with F = (Aj)j e j and Z = RS(A) imply directly 
statements (i). Statement (ii) follows from Proposition [8] (ii) . □ 

An equivalent statement to Definition [Kjl concerning complete bases of 
rightmost index exclusively, is given below. 

Theorem 13. Let Z be a subspace of J 7 ^. Then F = (Fj)j e j is a 
complete basis of rightmost index of Z if and only if Z = span(Fj)j £ j and the 
sequence (pj)je,j of rightmost index ofF is injective. 

Proof. Let Fj = (fjk)keu- On the contrary, let there are jo, ji in J such that 
jo ^ ji and p jo = pj x . Let also mi := p n and A := fj imi ,Xi := f jomi 
(in that order). Certainly A ^ 0, A x ^ and F jo = (f joQ , f jol , Ai, 0, ...), 
Fj 1 = (/jjQ, /jii, Ao, 0, ...), where Ao,Ai have as column position mi. Thus 
^(AoF JO — AiFjJ < mi and AoFj- — AiF^ ^ 0, since Fj ,Fj 1 are linearly 
independent. Let us call m 2 = £(X Q Fj — AiF^). As AoF JO — AiFjj € Z and 
91(Z) = 91(F), we infer m 2 G 91(F). Thus, there is some Fj 2 in F such that 
£{F J2 ) — m 2 and m 2 < m\. As m 2 = ^(A F JO — AiF^-J = £(Fj 2 ), there is A 2 ^ 
such that m 3 = £(X Fj — XiFj 1 — A 2 F J2 ) and m 3 < m 2 . Now X Fj — XiFj 1 — 
A 2 F J2 ^ 0, since Fj , Fj x , Fj 2 are linearly independent, thus m 3 6 91(F). This 
process defines a strictly decreasing infinite sequence m = (mj) in N, which is 
impossible. The converse statement is equivalent to Proposition [11] □ 
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Unlike Theorem [LH the sequence (Cj)jeJ of a complete basis of leftmost 
index is not necessarily injective. To see this, let us recall the basis aU {eo} of 
J-^, as defined in the previous counterexample. Call this basis F. As £(F) = 
lj, it follows that ^(J 7 ^) = £(F). Thus F is a complete basis of leftmost index 
of J 7 ^) but the sequence (Cj)jeJ is not injective, since Co = Ci = 0. 

Corollary 14. Let F = (Fj)j e j be a complete basis of rightmost index of 
Z. (i) The set F U {^i}i^ u \m.(F) IS a complete basis of rightmost index of 
(ii) The set {ei} i6w \<y;(F) is a basis of a complementary space of Z. 

Proof, (i) Theorem [J3] entails that p : J 4 fH(F) is bijective. Thus F can 
be relabeled by setting F' p . = Fj for all j 6 J and F' = {F^} i£!H ( F ). Let 
= F' U {ei}ig w \fR(F)- Since F' and F coincide as sets, using the same 
argument as in the proof of Proposition [TT] (i), we deduce that X is a complete 
basis of rightmost index of ~F^\ as required. Statement (ii) follows directly 
from (i). □ 



4 Lower Row-Reduced and Row-Echelon Forms 

The terms "lower" and "upper" readily characterize matrices in echelon form, 
but not directly matrices in row-reduced form. However, if A G MFM w (J r ) is 
in LRRF, there is a permutation matrix, P, such that P ■ A is in LREF (see 
Proposition I^Tj) . A similar result holds for matrices in URRF (see Proposition 
I26p . In this regard, with an abuse of language, the terms "lower" and "upper" 
are also used to distinguish wxu matrices in row-reduced form. These forms 
of row-finite matrices generalize analogous results on finite matrices. 

Definition 15. Let A G MFMLj ( J 7 ) . Let also (Aj)j^j be the sequence of 
nonzero rows of A = (dki)(k,i)eu>xu- Then A is said to be in lower row-reduced 
form if the following conditions are satisfied: i) Oj P] = 1 for all j £ J (Right 
leading coefficients are ones), ii) If j G J and k € to such that k ^ j, then 
Qfepj = (A column containing a right leading one has zeros everywhere else). 

In order to cover the case of row-finite uj x cj matrices of infinite nullity, the 
standard condition on finite matrices in echelon form which requires that zero 
rows are to be grouped together, is not included in the subsequent definition. 

Definition 16. The matrix A G RFM w (J r ) is in lower row-echelon form 
(LREF) if the sequence (pj)j &UJ of row-length of A is strictly increasing. 

Substituting leftmost for rightmost coefficients in Definitions [15] and [TBI 
row-finite ojxuj matrices in URRF and in UREF are formally defined; in accord 
with the prevailing definitions of finite matrices in row- reduced and row-echelon 
form. If A is in LRRF (resp. LREF) and A ~ B, then A is said to be a LRRF 
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(resp. LREF) of B. Inasmuch as row permutations on a matrix in LRRF do 
not affect Definition [T5l the following Proposition is a direct consequence. 

Proposition 17. Let P be a permutation us x uj matrix. If A G MFM w (J r ) 
is in LRRF, then P ■ A is in LRRF and <R(A) = 9\(P ■ A). 

Proposition 18. Let A = (aki)(k,i)eu>xu> ° e m LRRF. Then the map 
p : J H> 91(A) of row-length of A is bijective. 

Proof. By definition p is surjective. Let k,j G J such that k ^ j and pk — Pj — 
m. Definition I15f i) implies that akm = a kp k = 1. As k ^ j, Definition I15f ii) 
implies that akm = Ofep, = 0, which is impossible. Thus p is also injective. □ 

Since row-finite matrices in LRRF and LREF are associated with injective 
maps of row- length, Corollary [T2l entails the following statement. 

Proposition 19. Let A e MFM^J") be in LRRF or in LREF. i) V\(A) = 
£H(RS(A)) and p : J h-» <H(RS(A)) is bijective. ii) TJie set of nonzero rows of A 
is a complete basis of row-length ofRS(A). iii) card(VF) = nul(A). 

As shown below, the existence of a row equivalent LRRF of every matrix 
in KFM w (J r ) can be deduced from Theorem [5p). 

Theorem 20 (Existence). A row-finite u> x to matrix H in QHF is si- 
multaneously in LRRF and in LREF. Conversely, a row-finite to x uj matrix in 
LRRF and in LREF is in QHF. 

Proof. As the sequence of row- length (pj)jeJ °f H is strictly increasing, it 
follows that k < j => pk < Pj- The latter inequality implies that CLk Pj is 
positioned further to the right than the rightmost one of the fc-th row and so 
a kpj — for all k £ J with < j. Also, = for all k £ W. In view of 
Definition & iv) , the condition (ii) of Definition [T51 follows. As the condition 
(i) of Definition [T5] is trivially satisfied, the direct implication follows. The 
converse implication follows directly from the definitions. □ 

Proposition 21. Let A G KFM W (J") and A^O. If the map p : J ^ m(A) 
of row-length of A is injective, there is a permutation lu x lo matrix P such that 
P ■ A is in LREF. 

Proof. It follows from A ^ that J ^ 
[5] implies the existence of a bijection a 
increasing. Let 

On account of J n W = and J U W = 



. Moreover, as p is injective, Theorem 
: J h> J such that (p aj )i^j is strictly 

if i e J , . 

if i e W y ' 

- uj, as pj — Oj G J for all j £ J and 
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/it : W M- W is the identity, we conclude that /i : u 4 w is bijective. Thus /z 
defines a permutation cj x u matrix P such that i(P ■ A) H = p a , , j G J and 
so the sequence of row-length of P ■ A is strictly increasing, as claimed. □ 

Corollary 22. If A G MFM^ (J 7 ) is in LRRF, there is a permutation matrix 
P such that P ■ A is both in LRRF and LREF (or in QHF) and P ■ A ~ A. 

Proof. Proposition [TH] implies that the map of row-length of A is injective and 
so Proposition [21] entails that there exists a permutation matrix P such that 
P A is in LREF. Proposition[T7]entails that P A is in LRRF too, and A ~ P-A, 
since P is non-singular. Thus Theorem [2H1 implies the assertion. □ 

Theorem 23 (Uniqueness). Let A, B G RFM^J 7 ) be in LRRF and A ~ 
B. There exists a permutation matrix P such that A = P ■ B. 

Proof. In view of Corollary[221 there exist permutation matrices R, S such that 
Qi = R - A and Q2 = S ■ B, where Q%, Q2 are QHFs of A, B, respectively. As 
Qi ~ A ~ £> ~ Q2, Theorem E] implies that Qi = y • Q2 for some permutation 
matrix V. Thus A = R^ 1 ■ Q\ = Rr 1 ■ V ■ Q 2 = R' 1 ■ V ■ S ■ B. Since 
P = R^ 1 ■ V ■ S is a permutation matrix, the assertion follows. □ 

The above statement extends Theorem[5](ii) to matrices in LRRF. It entails 
that two row equivalent row-finite u> x u matrices in LRRF may be different 
sequences of row- vectors but they are identical as sets of row- vectors. This 
justifies the "almost" uniqueness characterization of matrices in LRRF. 

5 Infinite Gauss-Jordan Elimination Algorithm 

The infinite Gauss- Jordan algorithm is primarily designed to generate a se- 
quence of matrices in LRRF, excluding row permutations, in order to meet the 
theoretical purposes of this paper (see Section [7]). At this stage of analysis, no 
qualitative distinction is made between leftmost and rightmost pivot strategics 
(LPS and RPS), since both strategies equally work on finite matrices, while the 
resulting matrix, upon algorithm completion, is not under consideration yet. 

Definition 24. A top submatrix of A <E MFM [i ,(J r ) of order n is the finite 
sequence of the first n + 1 rows of A denoted by A\ n = (Ak)o<k<n- 

The Algorithm: Let A G MFM LJ (J r ) have at least two nonzero rows. 
Otherwise, A consists of at most one nonzero row, thus being both in LRRF 
and in URRF and the process ends. Let A no ,A ni be the first and second 
nonzero rows of A respectively. Starting with the top submatrix A\ ni , the 
rightmost (resp. leftmost) nonzero entry of A no is used as a pivot to clear the 
corresponding entry (entry in the same column) of A ni (elimination elementary 
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operation). Let G ni be the resulting row. If G ni ^ 0, the rightmost (resp. 
leftmost) nonzero entry of G ni is used as a pivot to clear the corresponding 
entry of A no . Otherwise, the algorithm leaves a zero row and continues to 
the next step. Leading coefficients are normalized to one (scaling elementary 
operation) and the resulting matrix is a LRRF (resp. URRF) of A\ ni . The 
reduced matrix is augmented by successive rows of the remaining rows of A up 
to and including the first nonzero row encountered. Let A ni be a new included 
row. The Gaussian elimination uses the nonzero rows of the previously reduced 
matrix as pivot rows to clear corresponding entries of A, H resulting in G ni . If 
G rii 7^ 0, the Jordan elimination uses the leading coefficient of G ni as a pivot to 
clear the entries in the column above this pivot. Otherwise, the algorithm leaves 
a zero row and continues to the next step. Upon completion of normalization, 
the rii stage of the process ends with a matrix in LRRF (resp. URRF). This 
sequential process continues in this manner ad infinitum. 

Each stage of the algorithmic process, as described above, is divided in three 
parts: Gaussian elimination, Jordan elimination and normalization. 

Remark 25. In the standard version of the Gaussian elimination, row 
permutations are used to find a pivot to avoid a break down, whenever a zero 
appears as a candidate for a pivot. However, the approach adopted here avoids 
row permutations in searching for a pivot, by using as pivots the rightmost 
(resp. leftmost) coefficients of nonzero rows already created in previous stages. 
Evidently, the algorithm presented in this Section also works on finite matrices. 
For computational and programming needs, we can also work with finite aug- 
mented matrices by defining as column dimension of each augmented matrix 
the integer n, = max{Nj_i,^(A n< )}, starting with Ni = max{£(A„ ) , £(A ni )} . 



6 LRRFs versus URRFs and RPS versus LPS 

An intrinsic defect of row-finite matrices in URRF is analyzed in the present 
Section in connection with the infinite Gauss- Jordan elimination algorithm 
implemented with LPS. Example [28l shows that such defect is not due to an 
inherent weakness in the algorithm itself, but rather to the essence of row-finite 
uj x uj matrices in URRF, which do not preserve row-equivalence. 

Proposition 26. Let A E KFM^J 7 ) be in URRF. Then there is a permu- 
tation matrix P such that P- A is in UREF and in URRF and £(A) = £(P-A). 

Proof. We can rephrase Propositions \T7\ [TH [21] by using URRF and UREF 
in place of LRRF and LREF respectively. Then proceeding as in the proof of 
Corollary [22j the assertion follows. □ 

Proposition 27. If B,C 6 MFM W (J") are both in UREF and B ~ C, 
then £(B) = £(C). 
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Proof. Corollary QJ implies that £(B) = £(RS(B)) and £(C) = £(RS(C)). 
As B ~ C, it follows that RS(5) = RS(C), whence £(B) = £(RS(B)) = 
£(RS(C)) = £(C), as claimed. □ 

The following Example concludes the discussion of this Section. 

Example 28 (Counterexample). Let us consider the row- finite and column- 
finite uj x uj matrix: 



A = 



( 1 1 
110 
110 

v 



(9) 



The infinite Gauss- Jordan algorithm is implemented with LPS to row reduce 
A. After including the n-th row of A, the resulting matrix in URRF is of the 
form: 

( 1 ... (-l)™" 1 o ... ^ 
1 ... (-1)™- 2 ... 



U n = 



(10) 



\ ... 1 1 ... J 

We observe that, as the process progresses, the rightmost nonzero column moves 
further to the right. The latter entails that U n does not contain the previous 
reduced matrix U n -\ as a submatrix and the length of each row increases 
indefinitely. This is due to the fact that, the elimination of an entry causes 
the simultaneous generation of a new nonzero entry further to the right in the 
same row, which, in turn, is vanished by a successor pivot element and so ad 
infinitum. For instance, two consecutive forms of the first row are given by 

f 1, 0, 0,..., o, (-if- 1 , ,0,...) 
\ 1, 0, 0,..., 0, , (-1)™ ,0,...) 

Thus we must accept either that the process does not end up with a certain 
outcome or that upon algorithm completion all the coefficients above rightmost 
nonzero entries are ultimately vanished, thus reaching the identity loxlo matrix 
I. However, if one follows the latter view, then must also accept that every 
row in I is the result of an infinite sequence of elementary row operations. 
It amounts to the same to say that every row of I must be an infinite linear 
combination of nonzero rows of A. But this event challenges row equivalence. 
Using the statements established earlier in this paper a formal answer to this 
challenge is given in what follows. Since A is in LREF, Proposition \T§\ implies 
that m(A) = m(RS(A)). On account of <R(A) = {1,2,...}, it follows that 
«H(RS(A)), whence e RS(A). Consequently RS(A) £ = RS(I) and 
so Proposition [5] entails that A / I. The latter is to be compared with the 
relevant result showing that the indexed set n in Lemma |9] does not span 



14 



It is shown next that the only possible URRFs of A in are row permu- 
tations of I. Let U be in URRF and U ~ A. Proposition [26l implies that there 
is a permutation matrix, P, such that P ■ U is in UREF and in URRF. As A 
is in LREF and the indexing set of zero rows of A is empty, Proposition [T51 
implies nul(A) = 0. Let U* = P ■ U and £ : J h4 £({/*) be the map defining 
the sequence of leftmost index of U* . Certainly W = lo \ J is the indexing set 
of zero rows of U*. Since nul(A) = and A ~ t/*, it follows from Proposition 
©that nul(E/*) = 0. Formally card(W) < nul(C7*) = 0, whence W = and 
J = lo. Whereas A, £/* are in UREF and A ~ {/*, Proposition E71 implies 
£([/*) = £(A) = a;. As C : M> w is both surjective and strictly increasing, it 
follows that ( is an order isomorphism on lu. But the only order isomorphism 
from co to itself is the identity. Hence the leftmost ones of U* are the elements 
of its main diagonal. Since U* is in URRF, the elements above and below the 
main diagonal of U* are zero and so U* = I. Taking into account that P^ 1 
is a permutation matrix, the assertion follows from P ■ U = I U = P^ 1 ■ I. 
Consequently RS(A) § RS(I) = RS(Z7) and so A ^ U. 

The same arguments show the non-existence of URRF for an extensive class 
of non-invertible row-finite matrices such as three-diagonal infinite matrices. 

Let us next apply the infinite Gauss- Jordan algorithm implemented with 
RPS to A in ©. The resulting matrix is in LRRF, as displayed below: 



H 



( 



V 



/ 



(11) 



By applying the same sequence of row operations to the identity to x lo matrix 
I, the derived matrix, say Q, is given by 



Q 



( 

V 



l o 
-l l 
i -l 



/ 



Formally Q is non-singular, as being lower triangular with non-zero diagonal 
elements. Since H — Q ■ A, the row-equivalence of H and A follows. 



7 The Infinite Gauss-Jordan Algorithm Imple- 
mented with RPS and the Row-Equivalence 

The main goal of this paper is established in the current Section. It is shown 
that the infinite Gauss- Jordan algorithm implemented with RPS ends up as 
a LRRF form of a row-finite to x lo matrix respecting row equivalence. As a 
consequence, the constructiveness of a QHF is shown at the end of this Section. 
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From here onwards, C € RFM w (J r ) and C n denotes the row of index n 
of C. L n stands for the row of index n, after the application of the row of 
index i to the previously obtained Ln 1 \ either by the Gaussian [i < n) or the 
Jordan elimination (i > n). The entries of L$ will be denoted by l^j. In the 

Gaussian elimination, the rows L[ n 1 \ < i < n — 1, are successively applied 
to the row of index n, starting with the application of Lq" to C n resulting 
in ■ Then the row l!\ ^ is applied to resulting in L n and finally the 
row L^_i is applied to Li™ 2 ' resulting in Ln ■ Aimed at normalizing the 
leading coefhcient to one, let us define 

G n ={ (12) 
otherwise 

where l n n p ~ l> denotes the right leading coefficient of L^^ x \ In order to unify 
formulas, we shall further adopt the notation Ln ^ = C„ and G„ = ii"', 
since these symbols were not previously used. By analogy, the entries of G n 

In) 

will be denoted by g n j, whence g n j = l nj ■ The Jordan elimination concerns 

the application of G n to Lf 1 ^ resulting in L^\ < i < n — 1. As no fur- 
ther normalization is required (see Subsection [721, upon completion of Jordan 
elimination, the derived matrix is in LRRF denoted by 

/4 n) \ 



C [n) 



T (n) 



(13) 



At this point, the ro-th stage of the process is completed and the subsequent 
stage starts by including the next nonzero row of C . 

7.1 Gaussian Elimination 

The Gaussian Elimination process carries out the reduction of C n to G n . Ev- 
idently, if C n = 0, then G n = 0. In all that follows we shall assume that 
C n 7^ 0. As L\ n ^ for < i < n — 1 remain unchanged at this stage of 
process, we employ shorthand notation for the row-length of by setting 

Pl = t{L ( ^ 1] ) (instead of p^ n_1) ) and p n = £{G n ). If ^ 0, then these 

are the pivot rows used by the Gaussian elimination. 

Let < i < n - 1, Lj n-1) ± and L { t X) ^ 0. The reduction of l4* -1) to 
Ln through the pivot can be described by the relation 

Llp^Lt^ + ^L^, (14) 



l(i 



where Xn '■= —Inpi^- In terms of scalar coordinates, (fT4|) takes the form 



a=^ 1) +Ar i) ^r 1) as) 



for k £ cj. Formally, if p; > £(£« then ln Pi ^ — 0, and so if A„ 1 ' ^ 0, 
then pi < £(Ln In this latter 1 ' ) is the rightmost one of L^ n X \ 

the (n, pi) entry of Ln is eliminated by the (i,Pi) pivot element of L ^ 
according to ify = l„ Pi 
such that < i < n — 1 



according to ify = ln Pi + An & ^ — ln Pi — ^ip; 1 ^ -1=0. Hence for all i 



til = 0- (16) 



"np 

As a consequence, L„ ^ L„ 1 ' if and only if i,(™ 1 ' ) ^ and A^ 1 1 ' ^ 0, 
and we shall refer to this transition as an effective reduction of L« to L„ 
through the row pivot L^ n_1 . The following cases exhaust all the possibilities: 

i) If £(L%~^) < p h then A^ 1} = 0. Hence (O gives L$ = L { ^ 1] 
and no effective reduction occurs. Certainly £{L^ 1] ) = £(L { n ] ). 

ii) If ii^'V) = p h then a£ _1) ^ 0. Hence (H gives ^ 
and an effective reduction occurs. Certainly £(L^ 1} ) > l^). 

iii) If £(Ln 1 ) > Pi, then an effective reduction may or 
may not (A„ ^ = 0) occur. In both cases: £(Ln~^) = £(L^). 

The above results entail the inequality: 

£(G n ) < ... < < £(Lt 1] ) < < (17) 

Let < j < n - 1 and 4 n_1) ^ 0. Since is in LRRF and l{ n ~ 1] is a 

rightmost one, it follows that all the entries of Cy 1 ^ 1 ) positioned at (i,Pj) with 
i =/= j and < i < n — 1 are zero, that is 

i£ _1) =0. (18) 

Setting A; = p., in (fTS")) , on account of (fT5|) . for every i such that < i < j < n— 1, 
it follows that Z^. = Z„ Pj . \ The latter applied with i = 0, — 1 gives: 
c n pj — Inpf 1 — Inpj = ■■■ = Inpj • As an immediate consequence, the factor 



A}, ; in (O and (JT5J) is given by 

A<r 1) = -c„ Pl . (19) 

Let us now consider the case in which the index i is the immediate successor 
of j such that 1$ ^ Ln ■ Typically ([T4|) takes the form 

L«=lW) + A W L (-D j (20) 
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where < j < i < n - 1. On account of JTS]) and ([T8)l. ((20)) implies that - 



Inpj 'i p . = 0. This entails that the Gaussian elimination does not change 
zero entries previously obtained by corresponding pivot rows. Accordingly 



l& = (21) 

for any i, j such that 0<j<i<n — 1. Setting i = n — 1 in (|2ip we infer 
InpJ 1 ^ = for every j such that < j < n — 1 and so g npj = 0. Moreover, 

if £„"lx 7^ 0, then (fT6| applied with i = n — 1 gives /lp~-i = an d so 
5np„^.i = 0. From the previous two statements, we conclude that for all j such 
that < j < n - 1 



9n P] = 0. (22) 

n-l 

Trivially |Q3J) implies: Z4 n-1 > = + L t~ l) ■ 0n account of [p]). 



i=0 



the latter relation takes the form: 

n-l 



The relation (|23[) indicates the elementary operations involved in the row re- 
duction of C n to Li™ -1 '. These operations, followed by a scaling operation, 
result in G n , as indicated in (fT2")l . Let (£v n_1 ) : G n ) be the augmented matrix 
derived by appending the row G n below the matrix This matrix is not 

in general in LRRF, since at this stage of progress the Jordan elimination has 
not started to operate yet. However (Z^™" 1 ) : G n ) shares a common property 
with C^ n \ as shown below. 

Proposition 29. Let J n he the indexing set of nonzero rows of the matrix 
(£(«-!) • Q n y if [pj)j eJn is the sequence of row-length of (C^' 1 ^ : G n ), then 
the map p : J n 9 i 1— »• p$ G uj is injective. 

Proof. Case 1. Let i,j £ J n such that i ^ j with i < n and j < n. As 
is in LRRF, it follows that pi ^ pj, whence the assertion. Case 2. Let i = n 
and j < i. If G n = 0, then n $ J n , whence the assertion follows. If G n ^ 0, 
then n £ J„. Certainly g nPn 7^ 0, as being the right leading one of G n . On the 
contrary we assume that pj — p n . As < j < n — 1, on account of (|2"2"|) . the 
contradiction follows from g nPn — g npj = 0. □ 

7.2 Jordan Elimination 

The Jordan elimination comprises the second part of the n-th stage of the 
process. If G n ^ 0, G n is used as a pivot row to eliminate the entries of 
preceding rows. Taking into account that the preceding rows of G n are of the 
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form L,™ 1 ' ) for < i < n — 1, the reduction of ^ to through G„, can 
be described by 

L («) =L (»-D +A ("-i) Gn) (24) 

where A,[™ 1 = — . By analogy to what was previously said, the effective 

reduction of the z-th row through G„, that is ^ L^ - , occurs if and only 
if G n ^ and A|" _1) ^ 0. If L { ^ 1] ^ for < i < n - 1, Proposition [H 
implies that £(G„) = p„ ^ Pi = 1{L { ^ 1] ). Besides this, if £(G n ) > e(L[ n ~ 1} ), 
then A^ -1) = = and hence (JUJ) implies that L 4 (n) = From the 

last two statements we deduce that, if L^' ^ L^ n_1 \ then 

^(G„)<£(i^ 1) ) (25) 

for < i < n- 1. We infer from ([24]) and ([25]) that in all cases ^ 
or if 5 = L { r l) ) 

£(L^)=t(L^) (26) 

for all n = 1, 2, ... and all i : < i < n - 1. Thus £(1^) = t{L,f +1) ) = ... and 
so 

£(Gi) =i{L ( [ l) ) Vn>i. (27) 

In view of Example ?7„ in (ITU]) shows that the analog of (|2"T|) does not hold, 
if the algorithm is implemented with LPS. We conclude that only the Gaussian 
elimination can generate new zero rows and new row lengths. The latter along 
with the fact that the Gaussian elimination acts only once on a nonzero row 
entails that Pi = 1{L^) for all n with n > i and so the shorthand notation 
for pi = £(Gi) employed in Subsection 17.11 can also be used for all n > i. 
Furthermore, since the Jordan elimination does not affect right leading ones of 
preceding rows, in each stage the normalization process needs just one scaling 
operation given by (fl"2)) . By ([25]) . ([26]) and ([27]) , respectively, we deduce that if 
L (n) ^ £ (n-i) ) then £( Gn ) < ^if" 1 )) = £(L\ n) ) = l(Gi) for i < n - 1. Thus 

i{G n )<i{Gi) (i<n-l), (28) 

whenever G n had effectively eliminated an element of the i-th row. 

Corollary 30. For every n > i 

G t =0^ 4 n) = 0. (29) 

Proof. Since n > i, the direct implication follows from the fact that algorithm 
leaves zero rows unchanged. The converse follows directly from ([2~T]). □ 

By virtue of ([17]), ([27]) implies £(Xj n) ) < £(Ci) for all i e w and n S w. 
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Proposition 31. If Gi 7^ and Gj 7^ for any i,j in uj with i ^ j, then 

HGJ^tiGj). (30) 
Equivalently the map J 9 i i— > £{Gi) £ w is injective. 

Proof. Let n > max{i,j}. Corollary [30l implies: 4""* 7^ and 4 7^ 0. As 
4 >4 are rows of the matrix C^ n \ which is in LRRF, we conclude that 
i(L\ n) ) ^ l{Lf ] ). Hence, the assertion follows from (J27}. □ 

7.3 The Main Theorem and Some Consequences 

Theorem[35]below shows that an arbitrary row of the form 4 remains invari- 
ant after a sufficient large n 6 uj. It demonstrates the main difference between 
LPS and RPS in the implementation of the infinite Gauss- Jordan algorithm. 

Theorem 32. For every k £ uj there exists M& £ uj with > k such that 

Wn:n>M k ^ = L ( ™ k} (31) 

Proof. On the contrary we assume the existence of some k £ uj such that for 
every m > k 

3n M :n M >M^4" M V4 M) - (32) 

With the aid of (|32|) a sequence of natural numbers is constructed as follows: 
Applying (|32|) with m = k + 1, then 

3n fc+1 :n fc+1 >fc + 1^4" fc+l) ^4 fc+1) . 

Let Mi = min{n fc+ i > k + 1 : L ( ^ k+l) ^ L { h k+1) }. Then applying ^ with 
m = Mi we have 

dn Ml ■ n Ml > Mi 76 _L fe 

and we define M2 = min{n Ml > Mi : 4™ Ml *' 7^ Lj. Ml ^} and the process continues 
ad infinitum. Let Mo = k + 1. Evidently Mo < Mi < M2, .... For each Mi = 

min{n Mi _ 1 > Mj_i : 4 Ms_1 7^ 4 Ml_1 ^} the effective reduction of 4"* ^ to 

-^fe M ^ through the pivot G Mi can be described by 

r("i) _ r(M,-i) ^(Mi-l)^ 
fc — fe ~*~ k ^Ui 

Certainly 4 7^ 4 M,_1 ^ and m^_i < m$. It turns out that there exists an infi- 
nite sequence G Ml , G M2J •■• of successive pivot rows, which effectively eliminate 
entries of the k-th row. Let us now consider the corresponding sequence of nat- 
ural numbers £(G Ml ),£(G M2 ), ■■■■ Proposition I3T1 implies that £(G Mi ) ^ £(G Mj ) 
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for any i,j in uj with i ^ j. Thus the sequence (^(G Mi ))i eLJ determines an 
infinite subset of uj, say M = {£(G Ul ),£(G U2 ), ...}. Clearly the ordinal number 
of M is w, and we shall write for this ord(TW) = uj. We deduce from ([2"5| that 



for all i G w. Let us call I(pk) the initial segment of w determined by the 
natural number pk = £{Gk). The definition of ordinals implies ord(/(pfe)) = pk- 
We infer from ((33} that £(G Mi ) S f(/9fc) for all i G w, whence M C f(pfc). 
However, the latter is a contradictory statement, inasmuch as uj = ord(.A4) ^ 



By virtue of Theorem |3U for any row of index k G u, there exists Mfc with 
Mfc > k such that the row remains fixed for all n > Mfc. We thus can 

define Lk = for the above Mfc G uj. Accordingly the infinite Gauss- 

Jordan algorithm implemented with RPS results in a row-finite uj x uj matrix 
L := (£fc)feew Certainly each row Lk of L is constructed after a finite number 
of algorithmic steps. Thus Lk is ultimately a finite linear combination of Ci. 
If Mfc is defined to be the smallest integer such that Mfc > k and — L^^ 
for all n > Mfc, then 



The subsequent corollary follows immediately: 

Corollary 33. For every k G uj, Lk is a finite linear combination of C,;. 
Equivalents RS(L) C RS(C). 

Corollary 34. The following statements hold: i) <H(G) = <K(L) = 
SK(RS(G)) = 9t(RS(L)). ii) G; = if and only if = 0. 

Proof, i) For an arbitrary i G uj, it follows from (JSTJ that £(G») = ^(i- n) ) 
for all n > i. Applying Theorem [32] with n > m^ > i, we conclude that 
£(L\ n) ) = £(Li). Thus £(Gi) = £{U) for alH G uj and the first equality follows. 
As the maps of row- length of the nonzero rows of G and L coincide, it follows 
from Proposition[3T]that they are injective. Hence the last two equalities follow 
from Corollary [TU ii) It follows from ([29]). □ 

Theorem 35. The row-finite matrix L is in LRRF. 

Proof. Let L n be an arbitrary nonzero row of L and p n = £{L n ). As l nPrl stands 
for the rightmost one of L n , we are to show that lk Pn = for all k G uj such 
that k 7^ n. In view of Theorem 1321 if m > max{Mfc, m„}, then Lk = L^ and 
L n = Ln"\ Thus Z/fc, L n are rows of £( m ) and l^ Pn = Since £( m ) is in 

LRRF, it follows that z£™ = 0, as claimed. □ 



£(G Mi )<£(G k ) 



(33) 



ord(/(/9fc)) = p k % uj. 



□ 




(34) 
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7.4 The Row Equivalence of C and L 

In the sequel, the row equivalence of G and L is established. Let / be the 
induced linear mapping by G. Thus /(e„) = G„ for all n 6 ui and C = [/]]§. 
Let L = (lfe)fc ew be the sequence derived by applying the same sequence of 
row operations to the corresponding terms of E, which have occurred in the 
reduction of G to L. In view of ([34]) lfc is given by lfc = J2T=o ^ kiei - Since 
fO-k) = J2T=o ^w/( e i) = Eto = ifei we conclude that each nonzero row 

Lfc, k £ J, represents the element /(lfc), fc £ J, relative to E. Let also G — 
(Gfc)fc 6w be the matrix whose rows are derived by the Gaussian elimination, as 
defined by (|12l) and (|2"5|) . Corollary [Ml entails that G, L are associated with the 
same indexing sets of zero and nonzero rows designated by W, J, respectively 
and that G, L are associated with identical sequences of row-length. In analogy 
to L, the sequence G = (gfc)fce^, is defined by applying the same sequence of 
row operations to E, which have occurred in the reduction of G to G. Certainly 
f(Sn) = G «' neuj. 

Proposition 36. i) The set G is a basis of . ii) G - G. iii) RS(G) = 
RS(G). iv) The set {Gj}j e j of nonzero rows of G is a complete basis of row- 
length of RS(G). v) The set {g w } w ew JS a basis of Ker(/). 

Proof, i) If C n — 0, then G n = and so g n = e„. Let G„ 7^ 0. Since each term 
^ in (|23|) is ultimately a linear combination of Go, G„_i, we can write 
ii" ^ = G„ — X)fe=o a nkCk- By applying the same sequence of row operations 
to the corresponding terms of E, we reach v rl = e n — X)fc=o a nkGk- In view 
of (fT2|) . if L„ ^ 7^ 0, then g n = ( „ 1 l 1) v Tt , otherwise G n — L« = and 
g„ = v„. Thus writing g n = Ylk=o Ink^k, if G„ = the leading coefficient of 
g„ is 7nn = 1, otherwise 7„„ = 7^=17- Accordingly ( / y n k)(n,k)£uxu is a lower 

'"On 

triangular matrix with nonzero elements in the diagonal. Thus G = (g n )new 
satisfies ([6]) , and the assertion follows from Proposition [7] ii) Let Q be the 
matrix of passage from E to G. According to the previous statement G = [/]q- 
Thus ([2]) implies that G = Q ■ C and so G ~ G. iii) It follows directly from 
Proposition[6] iv) In view of PropositionlBTl Jsm i(Gi) e w is injective. As 
RS(G) = RS(G), the set {Gj}j^j is a generating system of RS(G). Corollary 
[34] and Proposition[TT1 imply the assertion, v) It suffices to show that the subset 
{g w }wew of G is a generating system of NS(G). Let n 6 NS(G). Writing n in 
terms of the basis G we have: 

n = 5>g 4 = 5> gl + ]T A igi . (35) 

On account of f(g w ) — for all w € W, we conclude that 

/(n) = + XiSi) = E A ^fe) =J2 XlGi - 

ie.J iew ieJ ie.J 
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But also /(n) = and so J2i£j ^iGi = 0. The linear independence of (Gj)j e j 
entails that A, = for all i G J and so (f35|) implies n — J2iew -^iSi? as 
required. □ 

Proposition 37. RS(£) = RS(G). 

Proof. Corollary l33l and Proposition l36T ii) imply, respectively, that RS(L) C 
RS(G) = RS(G). It remains to be shown that RS(G) C RS(L). Corollary [M] 
entails that D\(G) = 9l(L) = fH(RS(G)). For simplifying notation, let us write: 
m := 9t(RS(G)) - {pj}jej- Let g G RS(G) and g = ££ a.e, for Pk G 
Since p : J H> is bijective, we can relabel the set of nonzero rows of L by 
setting L' p . := for all j G J. Certainly £(L' p .) — pj for all j G J or = i 

for all i 6 !R. Without loss of generality, we assume that po < p\ < ... < pk 



and dehne g' = a po L' po + a pl L' pi 



' Pk 



L' Pk , or alternatively g' — a^L';. 



i=0 



Evidently g' G RS(L) and so g' G RS(G). We are to show that g = g'. 
Whereas L is in LRRF, in each nonzero row L[ = (l' im ) m eu, i G ?t, we have: 

(J m = for all m G £R with m ^ i and = 1. Thus, can be written as 

i-l 

L\ — ei + \_. C e m f° r an * £ On account of 

m=0 



X] = 5Z a '( ei + X 4n e m) = X^ ^ 4 + X! 



i=0 

iein 



i=0 
iG5R 



m—Q 

Pk i-l 



i=0 



i=0 



i=0 m=0 



m—Q 
m0K 



we deduce that 



Pk 



Pk 



9-9 



1=0 



P/,- 



i=0 



i>k 



( 



Pk Pk i—1 



i=0 



m=0 



V 



i=0 



i=0 m=0 
i6K m^m 



Pk i-l 



m=0 
m0M 



i=0 m=0 
iGW mg'SR 



It follows immediately that g — g' is a linear combination of e m with m ^ 91, 
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which in turn implies that £(g — g') £ 91. However, since g — g' E RS(G), it 
follows that g — g' = 0; for if otherwise £(g — g') G SH, that contradicts the 
previous result. Thus g — g 1 , and so g G RS(L), as claimed. □ 

Proposition 38. i) The set of nonzero rows of L is a complete basis of 
row-length of RS(C). ii) L is row equivalent to C. ii) L is a basis of J 7 ^. 

Proof, i) Whereas the map of row-length of the nonzero rows of L is injective, 
Proposition [T9l entails that (Lj)j £ j is a complete basis of row-length of RS(L). 
Thus Proposition [571 implies that (Lj)j^j is a complete basis of row-length of 
RS(C), as asserted, ii) Corollary |3~41 implies 1^, = g^, for all w 6 W. As a 
direct consequence nul(i) = nul(G) = card(W). As G ~ G, we conclude that 
nul(L) = nul(G) = nul(G). Since RS(L) = RS(G), Proposition © shows the 
assertion, hi) Evidently L = {l UJ } u ,gn' U {lj}jej- Proposition [36] entails that 
{g w } W £W is a basis of NS(G) and so is Moreover, {Lj}j e j is a basis 

of RS(G) and f(lj) — Lj, j G J. Proposition [8] (i) entails that is a 

basis of a complementary space of NS(G) and the assertion follows. □ 

As a general conclusion, a row equivalent LRRF, say L, of an arbitrary 
C G KFM^J 7 ) is constructed, by means of the infinite Gauss- Jordan algo- 
rithm implemented with RPS. Moreover, Corollary [2U entails the existence of 
a permutation matrix P so that the matrix H = P ■ L is a QHF of L. Since 
H ~ L ~ G, it turns out that H is a QHF of G. The latter provides a proof 
for the existence of QHFs, without invoking the axiom of countable choice. 

8 Construction of Submatrices of LRRF-QHF 

From a computational point of view the main objective is the construction of a 
sequence of submatrices of a QHF, H , of G G RFM u (J r ), as established in this 
Section. Following the notation of Section [7J we start with the construction of 
a chain of submatrices of a LRRF, L, of G. This is not a direct consequence 

. . (n) 

of the algorithmic process formulated in the previous Section, since L\ may 
differ from Li for small enough n and so may not be a submatrix of L. 

8.1 Construction of Submatrices of LRRF 

Let m > n. In view of (|13[) . it is convenient to introduce the matrix notation: 

/ 4 ro) \ 

(36) 



-•(m) I 



4 m) 



(m) 
n-] 

V Lt ] 



t y 
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Moreover A C B will indicate that A is a strict submatrix of B. Certainly 
£(n)| n= £(«). As £ (m) |„E £ (m) | m for n < m, C^\ n is in LRRF too. 

Proposition 39. For every n £ uj there exists e n £ ui with e n > n such 
that C^lnd L. 

Proof. Let n £ lu and < k < n. According to Theorem [351 for each k there is 
Mfe £ u> such that L k Mk ^ = L k . Let e n — max(Mfc)o<fc<n- As M k < e„, it follows 
that L[ Cn) = L k Mk) = L k . Thus C^\ n = (L k ) < k < n C L, as claimed. □ 

As a consequence of Proposition |39l a chain {£( e ™' |„},i etJ , is generated 
satisfying: 

£ (eo) |oC £ (ei) |iC ... C £ (e "Vc ... C £ (37) 

Using set-theoretic notation C^ n ^\ n — {(k,L k ) : < k < n} = L\ n , whence 
L = |J £ (£n) |„G MFM aJ (7 r ). The infinite Gauss- Jordan algorithm directly 

generates the sequence {£("- ) }„e w along with the subsequence {£( e "'} Iiew , but 
in general £ ( - e "- ) ^ i. However, by virtue of Proposition [39l since £ ( - e "- > \ n C 
£( e "-\ this algorithm also generates the chain {C^ en ^\ n }ne.u of submatrices of L 
satisfying (|37|) . Accordingly, given any desired number of rows, say n, if N is 
large enough (iV > e„), the submatrix £W |„ of £( N ' is also a submatrix of L. 

8.2 An Extension of the Infinite Gauss-Jordan Algorithm 
in Constructing Submatrices of QHF 

The infinite Gauss- Jordan algorithm implemented with RPS is extended by 
means of a reordering routine generating a chain of submatrices of a QHF of 
C £ M.¥M U (T). Let us call m(C|„) := max{^(C fc ) : < k < n). As L is in 
LRRF, the map of row-length of L is injective and so £(L n+ i) ^ m(L|„). In 
view of the proof of Proposition [2lJ the definition of fi : u i-> u in (JSJ) indicates 
that row permutations must apply to the set of nonzero rows exclusively, since [i 
maps J onto J. Meanwhile the position of zero rows should remain unchanged, 
since fj, : W H > W is the identity. As it is shown in this Section, these conditions 
prevent the grouping of the zero rows on the top of the permuted matrix, thus 
keeping the matrix in KJFMLj (.F) . 

Reordering Routine: Rearrange non-zero rows of L\ n in strictly increasing 
row-length, while leaving the position of zero rows unchanged. 

Choose a top submatrix of L, say L\ ko . The reordering routine applied 
to L\ ko results in a matrix Q( fe °) = P ko ■ L\ ko , where P ko is a permutation 
matrix. In the next step Q( fc °) is augmented by the row L k(t+ i. If L ko+ i = 0, 
a new row is included. If L ko+ i ^ and £(L ko+ i) < m(L|fc ) the reordering 
routine generates Q( fco+1 ) = P ko +i ■ L\ ko+ i moving L ko+ i in a lower position. 
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Meanwhile, the last nonzero row of g( fc o) of row-length m(Q^ fe °^) is placed in the 
highest row position of Q( fc o +1 ), thus not belonging to Q^ fco+1 ^|fc . Thereafter 
a new row is included and the process continues at infinitum. 

The infinite sequence (Q^)k>k consists of matrices in QHF. Moreover, we 
can start applying the reordering routine to any top submatrix of L. Fixing k, 
a matrix Q^\k will change, if there is some m with m> n such that L m ^ 
and £(L m ) < m(Q(") |fc). After moving L m in a lower position its successive 
nonzero rows are placed in higher positions, meanwhile the positions of zero 
rows are fixed. It turns out that, if k < n < m, then 



Q {m) \ k = Q (n) \ 
Q {m) \ k + Q (n) \ 

Thus, if k < n < m, then m(Q (m) | fc ) < m{Q {n) 
routine to a concrete matrix A - 



m(Q im) \k)=MQ {n) \k) 
m(Q {m) \k)<m(Q^\ k ) 



(38) 
(39) 



Q(3) 



( 1 



10 





u 
\ 



Let us apply the reordering 
, that is Q^ 3 ) augmented by L4. 



Q(4) 



/ 



\ 1 
The resulting matrix Q^ 4 ' is a QHF of A such that 



/ 1 











.. \ 



















1 
























V 





1 








Q (3) = Q (3) | 3 = 



/ 1 ... \ / 1 
0.. 
10.. 



... \ 



\ ... / 
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= Q (4) | 3 



V ... / 



and m(Q( 4 ^3) ^ Tn(Q^ 3 ^3). Furthermore, as the next example illustrates, the 
condition that the positions of zero rows must be fixed is sufficient to avoid 
grouping zero rows on the top of the matrix. 

Example 40. Let A be the row-finite uj x u matrix consisting of the 
same repeated row A n = (1,0,0, ...) for all n € uj. The infinite Gauss- Jordan 
algorithm is implemented with row permutations grouping zero rows on the 
top part of Q("). This process gives rise to the following sequence of matrices: 



Q(D 





1 




Q (2) =(000 

1 



Upon algorithm completion, the only possible alternative assumption to an 
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undccidable problem is a matrix of the form: 



Hi = 



/ ... \ 
... 



V i o o ... ) 



As the indexing set of zero rows is oj, the row indexing set of Hi is w + 1, 
whence H\ $ RFM^J 7 ). Nevertheless, by keeping the position of zero rows 
unchanged the outcome is the matrix: 



H 2 = 



(I ... \ 
... 
... 



V 



Since 1 + u> = w, it follows that H 2 G MFM^J 7 ). 

The subsequent theorem shows that row permutations produced by the 
reordering routine do not affect a top submatrix of Q' fe ' for large enough k. 

Theorem 41. For every k € u> there exists 8 k G u> with S k > k such that 

Vn : n > 6 k Q (n) | fc - Q (5k) \ k 

Proof. On the contrary, let there is some k € w such that for every 5 > k 

3n s :n s >S^Q^\ k ^Q^\ k (40) 

In view of ([55]) . the latter statement is equivalent to the following: There exists 
k G uj such that for every S > k 



3n s :n 5 >6^ m(Q^\ k ) < m(Q {d >\ k ) 



(41) 



A sequence of natural numbers is constructed as follows. Applying (|41[) with 



5 = k + 1, there is n k+ i : n k+1 > k + 1 such that m(Q ( ™ t: + l) |fc) < m(Q 



(fc+i)| 



Let us call Si = min{n fc+ i > k + 1 : m{Q^ nk +^\ k ) < m(Q^ k+ ^\ k ). As a direct 
consequence, m(Q^ (5l '|fc) < m(Q^ fc+1 ^|fc). Applying (|4"Tj) with (5 = (5i we have 

3n Sl : n 5l > <5 X m(Q^\ k ) < m(Q^\ k ) (42) 

and we define S 2 = mm{n Sl > S 1 : m(Q (n ' 5 i ) | fe ) < m(Q (5l) | fe )}. Certainly 
m(Q^ 2 ^|fc) < m(Q^ l5l - ) |fe). The process continues in this manner ad infinitum. 
Let us denote So ■= k + 1. Inasmuch as So < <5i < S% < ■■■ and m(Q^°^|fe) > 
tn(Q' <5 ^ fc) > m(Q^ 2 ^ fc) > a strictly decreasing infinite sequence in u is 
constructed, which is impossible. □ 
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As the rows of Q^\k, n> 5k, remain invariant under further row permu- 
tations by means of the reordering routine, we can write Q^ Sk '\k= (H n ) < n <k 
for all k € uj and define H = \J k£uj \ k = \J keu {(n,H n ) : < n < k}. 

Certainly H £ RFM w (J r ). Moreover, taking into account that L is a LRRF 
of C and H has the same sets of nonzero and zero rows as L, it follows that 
RS(L) = RS(iJ) and nul(L) = nul(H). Thus Proposition © implies H ~ L, 
Also, as H is in LRRF of strictly increasing sequence of row-length, H is a 
QHF of C. As a conclusion, applying the reordering routine to L we deduce: 

Corollary 42. For every n € w there is <5„ € cj with <5„ > n such that 
Q'* n '| n IZ H. Thus a chain of top submatrices of H is generated satisfying: 

Q(5o)| oC Q(«0| lC ... c Q(^)| n c ... c ff (43) 

The Extended Algorithm. The Infinite Gauss- Jordan algorithm is sup- 
plemented by including the reordering routine as the forth and final part of the 
n-th stage of the process. In this setting, instead of applying the reordering 
routine directly to submatrices of L, it now applies to matrices of the form 
£("), which may not be submatrices of L. However, as we show in what fol- 
lows, given any desired number of rows, say n, for a large enough N > n, it 
turns out that C^\ n n L and simultaneously Q^ N ^\ n n H, where H is a QHF 
of C. Let S n ,e n be as in Corollary and Proposition [3^1 respectively. For 
any n € uj, let N = max{e n , 8 n }. At the 7V-th stage, as N > e n , the algorithm 
gives £W such that C^ N ^\ n = £ < - e "'|„= L\ n d L. At the eAr-stage, on account 
of N > S n and C^ N ^ — L|jv, the reordering routine applied to C^ N ^ gives 

gW| n =g(^)| n c#. 

An Alternative Formulation. In order to construct a chain of submatri- 
ces of a QHF of C, the uniqueness of Q^\ n provides the following alternative. 
Any Gauss-Jordan elimination scheme, including the latest software innova- 
tions such as partial pivoting techniques, when implemented with RPS on a 
top submatrix C\n of C gives a matrix Q( N *> in LRREF. If N is sufficiently 
large Q} N ' contains a submatrix \ n of a QHF of C, since the set of all 
zero rows grouped on the top of QS N > is finite. Thereafter, the infinite Gauss- 
Jordan algorithm, supplemented by the reordering routine, is applied to the 
matrix Q^ N ^ augmented by successive rows of C, thus generating a chain of 
submatrices of a QHF of C, as described by (|4"3")l . 

8.3 Examples on the Construction of QHF 

The infinite Gauss- Jordan algorithm is implemented with RPS to row reduce 
two additional concrete examples. Example 33] was treated by recursion in 
[1] and the same results are recovered here. Special attention is paid to the 
conditions which make the recurrence ([3J applicable. In Example [44] the matrix 
representation of a partial differential operator is considered. In this event, 
condition ([5]) is not satisfied, making impossible a direct application of ([3j). 
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Example 43. Following Fulkerson, we define the row- finite ui x u> matrix: 



/ o 
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3 
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2 






















1 








1 
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1 






V • 
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5 





1 


4 





3 


3 





(44) 



The first three rows of A are given by A = e 2 + e 3 , A\ - 
and the remaining rows are generated by the formulas: 



0,A 2 



e 3 + e 5 + e 6 , 



*2n+l 



i2ri 



{n + l)A 2n + ^A 2t , forn>l 



i=0 



for n > 2 



The 



= e 3 + e 6 + e 3n+2 + e 3 („ +1 ) 

Let a € Hom^r(J r ^^) be the linear mapping induced by A, thus A 
implementation of the infinite Gauss- Jordan algorithm with RPS, including the 
reordering part, results in a QHF of A, say H. By applying the same sequence 
of row operations to E, which have occurred in the row reduction of A to H , 
the domain basis L = {L n }„ ew is derived. In what follows, the elements of L 
are appended next to corresponding rows of H occupying the right-end column: 



H= 



V 



\ 



/ 



e 




ei 




e 2 


- e 


e 3 


-2e 2 


e 4 


- e 2 


e 5 


— 3e 4 


e B 


- e 2 



e 



The defining relation of {A 2n+1 ) n > 1 is A 2n+1 - (n + l)A 2n - J27=o A 2i = °- 
On account of a(ej.) = A^, we deduce the following alternative calculation of 
a basis of NS(A): Li = ei, L 2 „+i = e 2 „+i - (n + l)e 2 „ - Yh=o e 2i, n > 1; 
in full accord with the result derived by the infinite Gauss- Jordan algorithm. 
The non-singular matrix of passage from E to L is given by 

\ 



Q 
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-2 


1 

















-1 
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-1 





-3 
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-1 











1 
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consisting of the coefficients of the vectors in L. It is easily verified that H = 
Q ■ A and A ~ H . It is worth noting the significantly less amount of automatic 
work in calculating simultaneously the above shown parts of H, Q compared to 
the corresponding amount of manual work in [1] . 

Let us next verify that A meets the condition (JSJ to Since the map of 
row-length of A is not injective, Theorem [T3] implies that the set of nonzero 
rows of A is not a complete basis of row-length of RS(A). However, the defining 
relation of A2 n +i entails that every odd row of A for n > 1 is a linear com- 
bination of the even rows {A 2 i}o<i< n of A. Thus spa,n({A 2n } neuj ) = RS(A). 
Furthermore, as £(A2 n ) — 3(n + 1) for all n S w, we infer that {p2n}neuj is 
strictly increasing. In particular, the set of length-equivalence classes of RS(yl) 
is L = {L3( n +i)}nGw and A2 n 6 I^3( n +i) f° r all n G u). Corollary [T2l implies 
that the set of even rows of A is a complete basis of row- length of RS(A). As a 
conclusion {A 2n } n&UJ , is available in advance and so Fulkerson's recurrence is 
directly applicable. By setting A P2ii = Ai n in © we obtain 

H = Aq, H 2 =A 2 ~ Ao, H 2n = A 2n - H 2 - H Q = A 2n - A 2 , n> 2, or 
H = e 2 + e 3 , H 2 = -e 2 + e 5 + e 6 , ...,H 2n = -e 2 + e 6 + e 3n+2 + e 3 ( n+1 ) 

which coincide with the corresponding nonzero rows of H . 

In the sequel, we shall adopt the notation J = w x w coupled with the 
standard well ordering on / defined by 

-<i (n, m) <==^ i + j < n + m or (i+ j = n + m and j < m). 

The elements of / are listed, relative to, as follows: (0,0) -<\ (1, 0) <\ 
(0,1) -< x (2,0) -<i (1,1) -< x (0,2) -<i (3,0),... and the ordinal number as- 
sociated with (/, -<i) is uj. Let us call y the standard basis of the space of 
bivariate polynomials equipped with the well ordering -<i. Formally y — 
{1, x, y, x 2 , xy, y 2 , x 3 , x 2 y, xy 2 , y 3 , ...}; in which the terms are listed with re- 
spect to -<\. We shall also use the following well ordering on /: 



The elements of / are listed with respect to <2 as follows: (0, 0) -< 2 (0, 1) <2 
(1, 0) < 2 (2, 0) < 2 (1, 1) <2 (0, 2) < 2 (0, 3), ... and the ordinality of (I, < 2 ) is w. 
Let us call X the standard basis of bivariate polynomials, but now equipped 
with the ordering ~< 2 , that is X — {1, y, x, x 2 , xy, y 2 , y 3 , y 2 x, yx 2 , x 3 , a; 4 ...}. 

Example 44. Let V be the space of bivariate polynomials. Let also D 
be the partial differential operator D :— (x 2 + xy + y 2 ) g ® dy + xy(J^ + 
considered as an endomorphism of V . The range of D is spanned by: 



~<2 (n,m) 




i + j < n + m or 

i+j = n + m and n + m is odd and i < n or 
i + j = n + m and n + to is even and j < m 



D(x n y m ) 



— nmx 



m— 1 



+ nmx y + nmx 



,n—X„m-\-l 



+ mx 



,n+l m 



y + nx y 



,n m+1 
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The matrix representation of D, relative to (X, y), is displayed in what follows: 

\ 



M = 
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(45) 



The infinite Gauss- Jordan algorithm, implemented with RPS and including the 
reordering part, results in a QHF of M: 



H = 



( 

1 



1 1 











^ 



00000000. 
00000000. 
00000000. 
00000000. 
1 0. 
10 0. 
-1 1 0. 
10 0. 
10 10. 
1. 



\ 



(46) 



By applying the same sequence of row operations to the identity lj x uj matrix 
I, the derived non-singular matrix of passage from X to L is given by 
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It is easily verified that Q ■ M — H and M ~ H. 
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As an illustration of the results of Subsection 18.21 concerning the extended 
infinite Gauss- Jordan algorithm, it is noted that: i) The smallest N such that 
£W| 6 C L and QW| 6 C H is N = S 6 = e 6 = 9. ii) Q( 9 )| 6 C Q( 9 )| 7 C Q( 9 )| 8 E 
Q (9) | 9 C H, thus S 9 = e 9 = 9 and i?| 9 = g( 9 ), as displayed in flU}. This 
justifies the size of the initial matrix M|g chosen to display the results of this 
example. 

Since nul(M) = 2, row permutations can be applied to L so as to group 
zero rows on the top of the matrix, thus generating the LRREF of M. This 
same result is obtained by applying any Gauss- Jordan elimination routine with 
RPS, directly to the top submatrix M\g of M. 

We observe that the map of row-length associated with M is not injective. 
By comparing (|45|l with (|46|) . we further notice the appearance of new row 
lengths in (l46l) occupying the columns of H of index 5, 9, .... Unlike the previous 
example, it turns out that no subset of the set of the nonzero rows of M , is 
a complete basis of row- length of RS(M). Therefore, the condition ((SJ) is not 
fulfilled, that is to say, the recurrence ^ is not directly applicable to M. 

9 Infinite Systems of Linear Equations 

In connection with the works of Toeplitz [5] and Fulkerson [3], the infinite 
Gauss- Jordan algorithm makes it possible to treat infinite linear systems with 
coefficient matrix in RFM^J 7 ) as finite linear systems. The problem of the 
existence and uniqueness of solutions of linear systems of the above-mentioned 
type is treated in a purely algebraic manner along with the full construction of 
the general solution of the system. In this setting, the coefficient matrix is used 
as a left operator on the space J- u (or J 700 ) of infinite sequences. As matrix 
multiplication requires, the elements of are represented by column vectors 
and the induced linear mapping is given by a : £ i— > a(£) = A • £, thus being an 
endomorphism of J r ". 

Let A e JRFM^J 7 ) and i,c£ J 7 ". The infinite linear system is of the form: 

A ■ x = c. (47) 

The extended Gauss- Jordan elimination algorithm, implemented with RPS and 
including the reordering part, results in a QHF of A, say H . As A ~ H , there 
is a non-singular lu x lo matrix, say Q, such that Q ■ A = H . On account of 

A ■ x = c Q ■ (A ■ x) = Q ■ c (Q ■ A) ■ x = Q ■ c H ■ x = Q ■ c 

the system takes the equivalent form: 

H-x = Q-c. (48) 

In the context of the results of this paper, a simple alternative form of the 
general solution of (|47| is formulated in what follows. 



32 



9.1 Homogeneous Solution 

Let W, J be the indexing sets of zero and nonzero rows of H — (/ifci)(fc,i)ewxa» 
respectively, and {pj } Jg j be the strictly increasing sequence of row-length of H . 
Let def(A) be the codimension of RS(A), called the deficiency or defect of A. 
Since the nonzero rows of H, form a sequence of complete row-length (Hcrmite 
basis), Corollary [14] (ii) implies that the subset of E indexed by oj\D\(H) spans 
a complementary space of RS(A), that is dei(A) = card(w\^H(if)). If c = 0, in 
view of (|4"5|) . the homogeneous system (14"T1) is equivalent to the system H-x = 0. 
The sequence x-h = (A- m )mecj m -F u •> where the "T" stands for transposition, 
is defined by 

t m (free variable) if m e lo \ d\(H) 

X = < w_1 

- ^ hiktk if m = pi G 91(H) 

whereas the terms tk in the sum of the second branch were previously chosen 
arbitrarily in the first branch. Since H is in QHF: — for k e D\(H) and 
k < pi, h ipi — 1 and = for k > pi. Thus for every i 6 J 

Pi pi-i pi-i pi-i 

Hi ■ x-h = ^ h^Xk = ^ ZiifcAfe + h ipi X Pi = ^ /ijfctfc — ^ /lifcife = 0. 

fc=0 fe=0 fe=0 fe=0 

k<£V\(H) k<£V\(H) 

Also Hi ■ x-u = for all i G W and so H ■ x-u = 0. Consequently x% is 
the homogeneous solution of (|47[) . Certainly the number of variables in a;-^ 
equals the def(A). Thus nontrivial homogeneous solutions exist if and only if 
def (A) > 0. 



9.2 General Solution 

In view of (|4"5|) . let us call k :— Q ■ c G J 7 ". Then the non- homogeneous system 
(|4"T|) is equivalent to 

H-x = k. (49) 

Since -ff^ = for all w G VF, it follows that • x = for all x G J 7 " and 
w G W\ On account of H w ■ x = k w a necessary condition for the existence of 
solutions of (l49l) is 

fc M = 0, for all weW. (50) 

If J = lu \ W, without loss of generality, we may assume that J = {jo,ji, ■■■} 
with jo < ji < •••• Let us define 

x v = (0, 0, 0, k jo , 0, 0, 0, k n , 0, 0, k n , 0, 0, ...) T 

t t t (51) 

Po Pi Pi 
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where kj i has the position pi. As hi p . = for j < i, hi Pi = 1 and hi m = for 
all m > pi, we deduce 

Hi ' Xp — hipo^jo '" foipi^i — foipi^i ki 

for all z 6 J. Assuming that k w = for all w € W in (14T)1) . then x = xp 
satisfies (|4*^| and so x-p in (j5lj) is a particular solution of (|4T|) . Accordingly, 
condition (|50l) is also sufficient. This means that the system (l47l) is consistent 
if and only if /c w = for all w g V4 7 . The general solution x = (i m )^ u of (|47|) 
is x — x-p + that is 

t m (free variable) if m € Ct> \ 

fcj, - 2^ /imfeifc if m = e 9\(H) 

k=0 



9.3 Examples on Infinite Linear Systems 

The homogeneous solutions of corresponding infinite linear systems with coef- 
ficient matrices defined in (T4~4l and ([41))) are respectively given by 

X-H =(*0) — to, to, •••) T 

#W =(*0) ti,t2, —t%, 0, £3, i 2 — t%, 0, £4, £3 — £4, £5, £3 — t5, ...) T 
X H =(to,tl,t2,t3,0, —t3, ti, 0, 0, t i: t 5 , — i 4 , 0, ...) T , 

where to,ti,t%, ... are free variables in T . 

Using the notation of Example 1281 the non- homogeneous infinite linear sys- 
tem C ■ x — s with coefficient matrix defined in ([9]) is consistent for any right- 
hand-side sequence s — (si)J euJ <E T M , since H in (fTTj) has no zero rows. The 
components of k — Q ■ s are given below: 

ko = so, h = -s + si, k-2 = s - Si + s 2 , ... 

In view of (|5ip. a particular solution of the system is x-p ~ (0, fco, fci, fc 2 , ■•■) and 
so the general solution is of the form 

x = (to, «o - t Q , -s + si + t , s - si + s 2 + t ...) T , 

where to is a free variable in T . 

Following the notation of Example 321 let us finally consider the non- 
homogeneous system A ■ x — c with coefficient matrix A defined in (|44|) . Let 
c = i c i)f eLU G J 7 ^- The components of k = Q ■ c are given by 

ko = c , ki = ci, k 2 = -c + c 2 , k 3 = -c - 2c 2 + c 3 , fc 4 = -c 2 + c 4 , 
&5 = -co - C2 - 3c 4 + c 5 , fc 6 = -c 2 + c 6 , ... 
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On account of k 2n +i = for n € U), since H 2n+ \ = for all n £ ui, we conclude 
that 

ci = 0, c 3 = c + 2c 2 , c 5 = c + c 2 + 3c 4 , ... 

Thus the form of c so as the non-homogeneous system becomes consistent 
must be c = (c , 0, c 2 , c + c 2 , c 4 , c + c 2 + 3c 4 , c 6 , ...) T , where c , c 2 , c 4 , ... are 
free variables in J 7 . According to (f5Tj) , a particular solution of the system is of 
the form: 

x-p = (0, 0, 0, c , 0, 0, -c + c 2 , 0, 0, -c 2 + c 4 , 0, -c 2 + c 6 , ...) T . 

Finally, in view of (|52[) the general solution of this system is given by 

x = (t ,ti,t 2 ,c - t 2 ,0,t 3: -c + c 2 + t 2 - i3,0,i4, -c 2 + c 4 + t 3 - i 4 , 
i5,-c 2 + c 6 +t 3 -t 5 ,...) T , 

where t$,ti,t 2 , ■•■ are free variables in J 7 . 
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